Copy past speed very slow for a large number of files on Windows [closed]

Posted by Arno2501 on Server Fault See other posts from Server Fault or by Arno2501
Published on 2012-12-11T16:26:27Z Indexed on 2012/12/12 11:07 UTC
Read the original article Hit count: 133

Filed under:
|
|
|
|

I've run the following test I've created a folder containing 15'000 files of 400 bytes using this batch :

@ECHO off
SET times=15000

FOR /L %%i IN (1,1,%times%) DO (
    fsutil file createnew filename%%i.txt 400
)

then I copy past it on my Windows Computer using this command :

robocopy LargeNumberOfFiles\ LargeNumberOfFiles2\

After it has completed I can see that the transfer rate was 915810 Bytes/sec this is less than 1 MB/s. It took me several seconds to copy 7 MBytes Please note that this is very slow.

I've tried the same with a folder with a single file of 50 Mbytes and the transfer rate is 1219512195 Bytes/sec. (yeah GB/s) instantaneous.

Why copying large number of files take so much time - ressources on a windows filesystem ?

Please note that I've tried to do the same on a linux system which runs on the same computer in a virtual machine (vmware player) with ext3 filesystem.

I use the cp command and the copy is instantaneous !

Please also note the following :

  • no antivirus
  • I've tested that behaviour on multiple windows computers (always ntfs) i always get comparable results (transfer rate under 1MB/s avg 7-8 seconds to copy 7 MBytes)
  • I've tested on multiple linux ext3 system the copy is always instantaneous for that amount (15000 files of 400 bytes)
  • The question is about understanding what makes windows filesystem so slow to copy large number of files compared to a linux one for instance.

© Server Fault or respective owner

Related posts about linux

Related posts about Windows